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Objective: To investigate the beneficial and adverse effects of a mental practice 
intervention on activities, cognition, and emotion in patients after stroke, patients with 
Parkinson's disease or multiple sclerosis. 

Methods: Electronic databases PubMed/Medline, PEDro, Science Direct, Cochrane 
Library, PsyclNFO, Rehadat, Embase, and Picarta were searched until June 2012. Fourteen 
randomized controlled trials in stroke and two randomized controlled trials in Parkinson's 
disease were included, representing 491 patients (421 with stroke). No randomized 
controlled trials in multiple sclerosis were identified. The methodologic quality of the 
included trials was assessed with the Amsterdam-Maastricht-Consensus-List (AMCL). 
Information on study characteristics and outcomes was summarized and evidence for 
effects described. Data from individual studies in stroke with same outcome measures 
were pooled. 

Results: The included 16 randomized controlled trials were heterogeneous and 
methodologic quality varied. Ten trials reported significant effects in favor of mental 
practice in patients with stroke (n = 9) and Parkinson's disease (n = 1). In six studies 
mental practice had similar effects as therapy as usual (n = 5 in stroke and n = 1 in 
Parkinson's disease). Of six performed meta-analyses with identical measures in stroke 
studies only two showed significant effects of mental practice: short-term improvement of 
arm-hand-ability (ARAT: SMD 0.62; 95% C//0.05 to 1.19) and improvement of performance 
of activities (NRS: SMD 0.9; 95% CI: 0.04 to 1.77). Five studies found effects on cognition 
(e.g., effects on attention, plan actions in unfamiliar surroundings) and four reported 
observed side-effects, both positive (e.g., might increase motivation and arousal and 
reduce depression) and negative (e.g., diminished concentration, irritation). 

Conclusions: Mental practice might have positive effects on performance of activities 
in patients with neurological diseases, but this review reports less positive results 
than earlier published ones. Strengths and limitations of past studies are pointed out. 
Methodologic recommendations for future studies are given. 
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INTRODUCTION 

Neurological pathologies affect many patients profoundly, caus- 
ing loss of activities, which often leads to intensive rehabilitation 
periods (Munneke et al., 2010; Keus et al., 2012). Three often 
researched neurological conditions of the upper motor neu- 
ron are stroke, Parkinson's disease, and multiple sclerosis. The 
complexity and intensity of neurological multidisciplinary reha- 
bilitation leads to high costs, which will increase as the numbers 
of patients with a neurological disorder rise (Evers et al., 2004; 
Struijs et al., 2005; Findley, 2007). 

While it is reasonably established that the overall process of 
neurological rehabilitation is effective, there is little evidence to 



support many specific rehabilitation therapeutic techniques (Keus 
et al., 2007a; Langhorne et al., 2009). Currently task orientated 
practice (i.e., practising a meaningful activity within the context 
of relevance) and intensity are considered the basis for effective 
therapeutic techniques (Trombly and Wu, 1999; Langhorne et al., 
2009). 

Mental practice of tasks is a relatively new therapy that is 
receiving a lot of attention within rehabilitation research (de 
Vries and Mulder, 2007; Langhorne et al., 2009). Mental prac- 
tice can be defined as: "The repetition or rehearsing of imagined 
motor acts with the intention of improving their physical execu- 
tion" (Malouin and Richards, 2010). Practicing a skill mentally 
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is a potential method to increase the amount of practice during 
rehabilitation in a safe way with relatively low costs. After ini- 
tial learning, the mental practice technique can be practiced by 
the patient independent from the therapist, location, and time 
of the day. 

Over the last decade, many articles investigating the effects of 
mental practice have been published, including five systematic 
reviews (Braun et al, 2006; Zimmermann-Schlatter et al, 2008; 
Nilsen et al., 2010; Barclay-Goddard et al, 201 1; Cha et al, 2012). 
Within neurological rehabilitation, the reviews are restricted to 
evidence of mental practice in stroke populations. Four reviews 
focused on upper limb abilities (Zimmermann-Schlatter et al, 
2008; Nilsen et al, 2010; Barclay-Goddard et al, 2011; Cha 
et al., 2012). All reviews included a relatively small number of 
randomized or clinically controlled trials [four (Zimmermann- 
Schlatter et al., 2008), five (Braun et al, 2006; Cha et al, 2012), 
or six (Nilsen et al, 2010; Barclay-Goddard et al., 2011) trials]. 
The total number of participants on which the evidence was 
based within the separate reviews ranged from 86 (Zimmermann- 
Schlatter et al, 2008) to 146 (Cha et al, 2012). All systematic 
reviews conclude that mental practice might be a potential tool 
to improve motor functions and activities, but that no definite 
conclusions on the effects of mental practice can be drawn yet, 
because the evidence base is relatively small. In addition, the 
reviews recommend that future research should include identifi- 
cation of who will probably benefit most from mental practice, 
incorporate follow up measuring points (retention) and inves- 
tigate whether there are differences in effects of the kind of 
imagery used (e.g., kinesthetic vs. visual imagery and first vs. third 
person's view). 

Despite the number of recent reviews, there is a need for 
constant updates of evidence because of the increasing numbers 
of publications and developments made in this specific area of 
expertise. Barclay-Goddard et al. (2011) described on-going tri- 
als in their Cochrane review in 2011 and estimated that with 
those studies included the population size on which the evi- 
dence would be based would triple (well over 400 participants 
included). Indeed new studies including some with relatively large 
sample sizes have been published recently (Ietswaart et al., 2011; 
Welfringer et al, 2011; Braun et al., 2012; Schuster et al, 2012) 
and have not yet been included in a review. 

Studies assessing the potential of mental practice up until 
now focused mainly on physical effects. Nilsen et al. (2010) 
concluded in their review that the variety of effects should be 
reported more extensively and investigated in future research and 
Barclay-Goddard et al. emphasize that side-effects, compliance, 
and integrity should be monitored more closely and reported in 
future studies (Barclay-Goddard et al., 201 1). Mental practice has 
been shown to regulate arousal, increase control of emotions and 
improve self-awareness and self-confidence in athletes (Murphy 
and Jowdy, 1992; Martin et al, 1999) and increase quality of life 
in patients with breast-cancer (Freeman et al., 2008). At the same 
time mental imagery may lead to negative side-effects in some 
patients with complex regional pain syndrome: pain and swelling 
increased after mental practice use (Moseley et al., 2008). 

Although the evidence is yet inconclusive mental practice is 
recommended to improve arm-hand-abilities in stroke guidelines 



(Royal College of Physicians of London, 2008; Australian Stroke 
Foundation, 2010). 

Besides in stroke, mental practice has been used in patients 
with Parkinson's disease and multiple sclerosis. Although it is not 
possible to compare these target populations in terms of pathol- 
ogy, symptoms, and recovery pattern, the clinical approach for 
all three patient groups share considerable similarities (e.g., the 
mental practice instructions given in clinical practice). Within 
rehabilitation all groups need intensive, task relevant practice. 
The underlying hypothesis for the value of mental practice is 
the same: ( 1 ) activation of brain regions related to motor func- 
tion (Johnson, 2000; Cunnington et al., 2001) and (2) increase 
of intensity of practice without the need to take issues related to 
safety and physical fatigue into account (Keus et al., 2007b; van 
Peppen et al, 2007). 

The effects of mental practice in Parkinson's disease and mul- 
tiple sclerosis have not been taken into account in earlier reviews. 

The main objective of this study was to undertake a system- 
atic review and a meta-analysis of randomized controlled trials 
investigating the beneficial and adverse effects of a mental practice 
intervention on activities, cognition, and emotion in patients after 
stroke, patients with Parkinsons disease or patients with multiple 
sclerosis. 

Strengths and limitations of past studies will be pointed out 
in order to give recommendations in the discussion section 
on the content and organization of future trials (Craig et al., 
2008). 

METHODS 

An overview of the search strategy, selection criteria, quality 
assessment, and meta-analysis is given in Figure 1. 

DATA SOURCES 

Computer-aided search was performed by four researchers (Susy 
Braun, Melanie Kleynen, Tessa van Heel, Nena Kruithof ) using 
PubMed/Medline, PEDro, Science Direct, Cochrane Library, 
PsycINFO, Rehadat, Embase, and Picarta. The authors hand- 
searched reference lists of obtained articles (reference and author 
tracking). Key words used were: stroke, Parkinson's disease, mul- 
tiple sclerosis, mental practice, movement and motor imagery, 
motor learning, rehabilitation, physical therapy, occupational ther- 
apy, activities of daily living. These search terms were used 
in Dutch and German articles as well and were translated if 
necessary. The detailed search strategy is available from the 
authors. 

STUDY SELECTION 

Type of study 

The studies selected in the review were all available randomized 
controlled trials in English, German, and Dutch up to June 2012 
that reported the effects of mental practice on the improvement 
of activities during the rehabilitation of adult participants after 
stroke, with Parkinson's disease or multiple sclerosis. In cross-over 
trials, only the first phase of the study was taken into account. 
A study with mixed population was only selected if the major- 
ity (over 50%) of participants had been diagnosed with stroke, 
Parkinson's disease, or multiple sclerosis. 
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Objective: 

To evaluate the effects of mental practice in patients after stroke, 
with Parkinson 's disease (PD) or Multiple Sclerosis (MS) 



Study Selection : 

- Randomized controlled trials (RCTs) in English, German and Dutch 
up to June 2012 

- Adult patients (>1 8 years old), diagnosed with stroke, PD or MS 

- Mental practice therapy; any task aiming at improving activities 




Records identified through database search n= 367 



- Cochrane library (n =25) 
-PsycINFO (n=103) 

- Rehadat (n=5) 

- Embase (n=60) 



- Pubmed/Medline (n=66) 
-PEDro(n=58) 

- Science Direct (n=43) 

- Picarta (n 7) 



Additional records identified though reference and 
author tracking n=0 



n=367 records screened by 
two independent subjects 



Excluded n=346 



n=2 1 full-text articles assessed for 
eligibility 



n=5 full-text articles excluded because: 

- The study was not a RCT (n=3) 
(Dijkerman et al., 2004; Hwang et al., 
2010; Kim etal., 2011) 

- The physical effects were only measured 
on the ICF-body function level (n=l) 
(Page et al., 2000) 

- Imagery was combined with circuit class 
training (n=l) (Verma et al.,201 1) 



n= 16 studies were included in the qualitative analysis 
Stroke n=14 
PDn=2 
MSn=0 




n=9 studies were included in the quantitative 
analysis 

(Bovend'Eerdt et al., 2010; Braun et al., 2012; 
letswaart et al, 2011; Liu et al.,2004, Page et 
al,. 2001, 2005, 2007, 2009; Welfringer et al., 
2011) 



n=7 studies were excluded from the quantitative analysis because of 

- Missing data (n=4) (Liu, 2009; Liu et al., 2009; Muller et al., 2007; 
Riccio etal., 2010) 

- Clinical important differences between groups at baseline (n=l) 
(Schuster et al., 2012) 

- Heterogeneity in outcome measures (PD, n=2) (Braun et al., 201 1 ; 
Tamir et al., 2007) 



FIGURE 1 | Overview of literature search. Abbreviations: MP, mental practice; PD, Parkinson's disease; MS, multiple sclerosis; RCTs, randomized controlled 
trials. 



Type of intervention 

The mental practice intervention could be added to therapy (e.g., 
using a taped instruction), embedded in therapy (e.g., problem- 
solving strategies in which overt movements are combined with 
mental practice during physical or occupational therapy) or given 



as an independent intervention. Studies in which special equipment 
was required (such as electro-myographic stimulation and feed- 
back or forms of virtual reality with computer simulation) were 
excluded. The content of the control intervention should allow the 
assessment of possible effects of a mental practice intervention. 
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Type of outcome 

Outcome measures can be divided into categories according to 
the international classification of the World Health Organization 
(ICF; WHO, 2013) of "function" (e.g., a function could be "pain" 
measured with a "numeric rating scale"), "activity" (e.g., an activ- 
ity could be "standing up from a chair" measured with a "timed 
up and go") and "participation" (e.g., participation could be "pro- 
viding meals" or "performing (paid) work"). For patients it is 
important that interventions reduce activity limitations to enable 
participation in society after returning home. Randomized con- 
trolled trials were selected if at least one measure was used for 
assessing physical effects on the activity level. 

DATA EXTRACTION AND QUALITY ASSESSMENT 

Screening on tittle and abstract was performed by two researchers 
(Susy Braun, Melanie Kleynen) independently. If based on the 
information in the abstract, it was not clear whether the study 
should be included the full-text of the article was assessed. 

Methodologic quality assessment of the studies was assessed 
using the Amsterdam-Maastricht Consensus List for Quality 
Assessment (AMCL; Van Tulder et al, 2003). The AMCL was 
originally developed by van Tulder et al. for the Cochrane 
Collaboration Back Group and includes all criteria of other 
prominent quality scales like the Delphi List (Verhagen et al, 
1998). It rates a study's internal validity and statistical report- 
ing using an 11-point scale (12 criteria), with higher scores 
indicating higher quality. Each criterion was scored either pos- 
itive (+, 1 point), negative (— , 0 points), or unclear (?, 
0 points), leading to a maximum score of 11 points per 
study (1 point for the items 2—11; Vi point for the items 
la and lb). 

To increase uniformity in the assessment the validity cri- 
teria were defined and then discussed by the two researchers 
(Susy Braun, Melanie Kleynen). Each item of the AMCL was 
explained in a separate document that provided uniform oper- 
ationalization of criteria. In the Appendix the definitions and 
cut-offs of the criteria of the AMCL are described (Table Al). 
For example "an acceptable percentage of withdrawals" (crite- 
rion 7) was defined as: 10% during the intervention period 
and from the remaining sample 10% during follow-up as sug- 
gested by Van Tulder et al. (2003) Compliance (criterion 5) 
was considered acceptable if participants themselves or thera- 
pists and relatives reported that the participants followed the 
given instructions. A follow-up period (criterion 10) of at least 3 
months was considered clinically relevant for this type of inter- 
vention. For these last two mentioned criteria (criteria 5 and 
10) reviews of other interventions within health care were used 
as standard, for generally accepted references in literature were 
not found (Huibers et al, 2003; Van Tulder et al, 2003). If 
disagreement on the scores persisted, a third researcher (Anna 
Beurskens) was approached to reach consensus. A study was 
defined as being of "sufficient quality" if the score was equal to 
or above six points. As standard references from the literature are 
missing, the cut-off was defined by the authors after references 
from other reviews in physical therapy were taken into account 
(van Tulder et al., 2001; Van Tulder et al., 2003; Huibers et al., 
2003). 



Authors of the included articles were contacted to clarify the 
items on which a question mark was scored. Both scores (blinded 
assessment as well as after contact with authors) are presented. 

Information was extracted from each included trial on: (1) 
study and population (including number of participants and 
mean age); (2) type of intervention. We for instance wanted 
to know if an instruction period for therapists and participants 
was embedded within the mental practice intervention period 
(e.g., stepwise approach, tools to check compliance) and what 
the content of the mental imagery session would be (e.g., what 
activities were rehearsed and how the imagery was instructed 
e.g., tape, therapist.); (3) type of outcome measure for physi- 
cal recovery (primary and secondary measurements, assessment 
time points, and follow-up period); (4) conclusion (is mental 
practice recommended and what are the (significant) effects on 
physical recovery). The conclusions were based on the results 
and conclusions in the articles but summarized by the inde- 
pendent researchers; (5) All included articles were screened 
on possibly reported effects on cognition or emotion as well 
as side-effects (quantitative and qualitative measures). If (sec- 
ondary) measures were used to consciously search and systemat- 
ically identify effects on cognition or emotion within the study 
design the results were categorized as "effects." Side-effects are 
described as effects that were not intended, but were observed 
and reported. These side-effects could be therapeutic (posi- 
tive) or adverse (negative). Both independent reviewers extracted 
data from the full papers by using a pre-structured standard 
form. 

DATA SYNTHESIS OF THE META-ANALYSIS 

A meta-analysis was conducted using Review Manager version 
5.1.6. (The Nordic Cochrane Centre TCC, 2011). Post interven- 
tion scores and if possible follow-up scores (at least 3 months) 
were used. Short- and long-term effects of the intervention were 
distinguished for two reasons: initial effects might extinguish over 
time and most studies did not perform a follow-up. Data from 
both measuring moments were analysed separately. Studies were 
excluded from the analyses if not all necessary data was provided 
in the article. No data was imputed. 

If a study included two control groups, mental practice was 
compared to the group with the least chance of improvement 
(e.g., control group). If no significant differences were found 
between those groups, it was assumed that no differences would 
be found between the two experimental groups. 

Studies with identical physical effect measurement instru- 
ments or studies with instruments measuring the same construct 
were pooled. The Mean Difference (MD) and 95% confidence 
interval (95% CI) was used if data was based on identical mea- 
surement instruments and the Standardized Mean Difference 
(SMD) for data based on different measurement instrument. 
Statistical heterogeneity was assessed using the I 2 -statistic. If I 2 
was greater than 50% outcomes were pooled using SMD with a 
random effects model. If there was a big variance in Standard 
Deviations (SD) across studies, reflecting differences in the real 
variability of outcomes, we also used the SMD. Sensitivity anal- 
ysis was done to investigate the influence of studies with ACML 
scores below 6 (lower quality studies). If for instance data were 
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pooled from studies with both lower and high quality, the analy- 
sis was performed first with all studies and then repeated without 
the lower quality studies (Barclay-Goddard et al., 201 1). 

RESULTS 

In total 367 articles were identified in Pubmed/Medline (n = 66), 
PEDro (n = 58), Science Direct (n = 43), Cochrane Library (n = 
25), PsychlNFO (n = 103), Rehadat (n = 5), Embase (n = 60), 
and Picarta (n = 7) and 346 were rejected based on title and 
abstract due to the following reasons: (1) the study was not a 
randomized controlled trial; (2) the study population did not 
meet the inclusion criteria; (3) the use of mental practice consid- 
ered specific equipment; (4) physical effects were only measured 
on the ICF-body function level; (5) a combination of the rea- 
sons above. Of the 21 remaining studies another five articles were 
excluded after reading the document full-text: one of the studies 
investigated the effects of mental practice only on the ICF-body 
function level (only the Fugl Meyer Assessment was used as out- 
come measure; Page, 2000), three studies were not a randomized 
controlled trial (Dijkerman et al., 2004; Hwang et al., 2010; Kim 
et al., 2011), and the last article which was excluded compared 
imagery combined with circuit class training with Bobath. As 
the control study did not involve circuit class training, it was 
unclear what the surplus of the imagery training would be (Verma 
et al., 2011). Furthermore, the effectiveness and efficiency of cir- 
cuit training has been established in earlier research (van de Port 
etal.,2012). 

No new articles were retrieved by using reference- and author 
tracking, leading to a total of sixteen included studies of which 
14 in stroke patients and two in patients with Parkinson's dis- 
ease. No randomized controlled trials with patients with multiple 
sclerosis were found. In total, 491 participants were included in 
this systematic review; 42 1 participants after stroke and 70 partic- 
ipants with Parkinson's disease. The total number of participants 
in a single study varied from 10 (Page, 2000) to 121 participants 
(Ietswaart et al., 20 1 1 ) . Group sizes for the experimental interven- 
tion varied from 5 to 39 and for the control intervention from 5 
to 32 (Page et al., 2009; Ietswaart et al, 201 1). 

EFFECTS PHYSICAL OUTCOME AND METH0D0L0GIC QUALITY 

The scores on the AMCL (range 0-11 points) of the included 
studies varied from 3.5 to 8 points after blinded assessment of 
the reviewers. After additional information was retrieved through 
authors contact (directly or through earlier confirmed informa- 
tion by the authors in the Cochrane review (Barclay-Goddard 
et al., 201 1)) to clarify the questions marks the scores ranged from 
6 to 9 points (Table 1). 

Based on the scores after assessment of the articles by the inde- 
pendent reviewers of the text only, 11 of the 16 studies scored 6 
points or more and were considered to have sufficient method- 
ologic quality (Page et al, 2001, 2005, 2009; Liu et al, 2004; 
Tamir et al, 2007; Liu, 2009; Bovend'Eerdt et al, 2010; Braun 
et al, 2011a, 2012; Ietswaart et al, 2011; Welfringer et al, 2011). 
After additional information was processed three more studies 
came to a total score above six points (Page et al, 2007; Riccio 
et al, 2010; Schuster et al, 2012). Of these 14 studies with at least 
sufficient quality, half (n = 7) showed overall positive effects of 
mental practice on arm-hand-function, activities of daily living 



and mobility of which six in stroke (Page et al., 2001, 2005, 2007, 
2009; Liu et al, 2004; Riccio et al., 2010) and one in Parkinson's 
disease (Tamir et al, 2007). In three high quality studies in stroke 
positive results were found in favor of the experimental group but 
not on all outcome measures (Liu, 2009; Welfringer et al., 2011; 
Schuster et al, 2012) and four high quality studies reported sim- 
ilar effects in the control and experimental group, of which three 
in stroke (Bovend'Eerdt et al., 2010; Ietswaart et al, 2011; Braun 
et al, 2012) and one in Parkinson's disease (Braun et al, 2011a). 
Of the two remaining low quality studies in stroke, one study 
did not find significant differences between groups (Muller et al, 
2007) and one study had mixed results (Liu et al., 2009). 

EFFECTS ON PHYSICAL OUTCOMES IN RELATION TO PATIENT 
CHARACTERISTICS 

Study characteristics of the included randomized controlled trials 
are shown in Table 2. 

Age of the participants varied from 40 to 84 years. The time 
post-stroke differed greatly, ranging from 0 to 7 days after stroke 
(Liu et al, 2009) to the chronic phase of recovery (>6 months 
after stroke; Page et al, 2007; Schuster et al., 2012). The average 
time after the diagnosis of participants with Parkinson's disease 
was between 5.2 and 7.8 years. Based on these qualitative descrip- 
tions mental practice seems to have potential effects in all ages of 
participants and phases of stroke recovery. In participants with 
Parkinson's disease, effects of mental practice were more often 
reported in the two included studies in participants with Hoehn 
and Yahr stage 1 or 2. 

EFFECTS ON PHYSICAL OUTCOMES IN RELATION TO INTERVENTION 
CHARACTERISTICS 

Six studies embedded mental practice in therapy (Liu et al, 2004, 
2009; Tamir et al, 2007; Bovend'Eerdt et al, 2010; Braun et al, 
2011a, 2012), nine studies added mental practice to therapy (Page 
et al, 2001, 2005, 2007, 2009; Muller et al, 2007; Liu, 2009; Riccio 
et al, 2010; Ietswaart et al., 2011; Welfringer et al., 2011) and 
one study investigated both embedded and added mental practice 
(Schuster et al., 2012). 

The intervention in the control group varied from a single 
intervention like relaxation therapy (Page et al, 2005, 2007), 
(general) information (Page et al., 2001), embedded therapy as 
usual (Muller et al, 2007; Tamir et al, 2007; Page et al, 2009; 
Bovend'Eerdt et al, 2010; Riccio et al, 2010; Braun et al, 2011a, 
2012; Ietswaart et al, 2011; Welfringer et al, 2011; Schuster et al., 
2012) to therapy according to the demonstration-then-practice 
method (Liu, 2009; Liu et al, 2004, 2009). 

The activities or skills practiced in the intervention group 
could be restricted to only movements of the arm (e.g., drink- 
ing from a cup; Page et al., 2005) or could contain complex tasks 
involving the entire body (e.g., going to the park; Liu et al., 2009). 
Frequency of the intervention varied from two to five times a 
week, while the intervention lasted between 30 and 60 min per 
session and continued for 2 to 10 weeks. The included stud- 
ies used different types of imaging (Mulder, 2007): participants 
were offered kinesthetic motor imagery (Page et al., 2005; Riccio 
et al, 2010; Ietswaart et al, 2011; Welfringer et al, 2011), or a 
combination of kinesthetic and visual motor imagery (Page et al, 
2001, 2007, 2009; Liu et al, 2004, 2009; Muller et al, 2007; Tamir 
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et al, 2007; Liu, 2009; Bovend'Eerdt et al, 2010; Braun et al., 
2011a, 2012; Schuster et al, 2012). 

Based on these qualitative descriptions it seems that different 
kind of interventions may have potential effects on activities (e.g., 
embedded and added mental practice were both reported effective 
and ineffective in different studies). 

EFFECTS ON COGNITION OR EMOTION AND SIDE-EFFECTS 

Five studies reported effects on cognition (Liu et al, 2004, 2009; 
Tamir et al, 2007; Liu, 2009; Welfringer et al, 2011) which 
were measured with the Stroop test (part B) in participants with 
Parkinson's disease (Tamir et al., 2007), the Color Trails Test 
(CTT; Liu et al., 2004) and the Cognistat (Liu, 2009) in partici- 
pants after stroke (Table 2). Participants with Parkinson's disease 
seemed to have an increase in attention and concentration after 
the mental practice intervention period (Tamir et al, 2007). In 
the studies by Liu et al. (2004, 2009); Liu (2009) the mental 
practice intervention involved strategy training and participants 
after stroke seemed to be more able to form cognitive maps of 
routes and plan actions in unfamiliar surroundings compared to 
the participants in the control group. Earlier positive findings on 
the CTT were however not repeated in a later study using the 
Cognistat (Liu et al, 2004; Liu, 2009). 

Positive observed side-effects reported in the stroke trials 
were increased autonomy (Braun et al., 2012) and increased 
sensations in and awareness of the left arm (Welfringer et al, 
2011). In Parkinson's disease research there was some indication 
that imagery might increase motivation and arousal and reduce 
depression (Tamir et al, 2007). 

Two studies reported acute adverse side-effects of mental prac- 
tice (Braun et al, 201 la, 2012) like "too much effort," "not worth- 
while," and "too confronting." Some participants after stroke 



showed diminished concentration and signs of tiredness at the 
end of mental practice training sessions (Welfringer et al., 2011). 

DATA SYNTHESIS OF THE META-ANALYSIS 

The meta-analysis was conducted using a selection of the stud- 
ies in stroke in which the same physical outcome measurement 
instruments were used (Table 3). 

A meta-analysis in participants with Parkinson's disease was 
not possible. Both studies use the Timed up and Go as an out- 
come measure, but Tamir et al. did not report the exact data (only 
figures provided; Tamir et al, 2007). Several outcome measures 
which had been used in at least two studies were excluded because 
of missing data (Motricity Index, Pinch/Hand force; Muller et al, 
2007; Riccio et al, 2010). The study of Schuster et al. (2012) 
was excluded because of clinical important differences between 
groups at baseline. Six times data could pooled in a meta-analysis. 
No sensitivity test could be performed as all studies that could be 
pooled were of at least sufficient quality. 

RESULTS ON MOBILITY— RIVERMEAD MOBILITY INDEX 

Data were available from two studies (Bovend'Eerdt et al, 2010; 
Braun et al., 2012) that randomized a total of 64 and 58 par- 
ticipants respectively. Pooling did not lead to significant effects 
assessed with the Rivermead Mobility Index directly after the 
intervention (p = 0.72; MD: -0.82; 95% CI: -3.04 to 1.41) nor 
at follow-up (p = 0.75; MD: -0.40; 95% CI: -2.90 to 2.10). 

RESULTS ON ARM-FUNCTION— ACTION RESEARCH ARM TEST 
(FIGURE 2) 

Data were available from seven studies (Page et al, 2001, 2005, 
2007, 2009; Bovend'Eerdt et al, 2010; Ietswaart et al., 2011; 
Welfringer et al, 2011) that randomized a total of 197 partic- 
ipants. Due to heterogeneity in the SDs of outcomes SMD and 



Table 3 | Overview of used measure instruments that could potentially be used in pooling. 



Outcome ARAT Pinch NRS/LS Ml BBS Bl 10 m RMI TUG 





Page etal., 2001 


X 


















Liu et al., 2004 






X 














Page etal., 2005 


X 


















Page etal., 2007 


X 


















Muller etal., 2007 




X 
















Liu etal., 2009 






X 














Liu, 2009 






X 














Page etal., 2009 


X 


















Riccio etal., 2010 








X 












Bovend'Eerdt etal., 2010 


X 










X 




X 


X 


Ietswaart et al., 2011 


X 


X 








X 








Welfringer etal., 2011 


X 


















Braun etal., 2012 






X 


X 


X 


X 


X 


X 




Schuster etal., 2012 










X 


X 











Tamir et al., 2007 x 
Braun et al., 2011a x x x 

Abbreviations: ARAT Action Research Arm Test; NRS/LS, Numeric Rating Scale/Likert Scale; Ml, Motricity Index; BBS, Berg Balance Scale; Bl, Barthel Index; 10m, 
10 m walking test; RMI, Rivermead Mobility Index; TUG, Timed Up and Go. Gray Shading: Data could be pooled. 
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Experimental 



Control 



Std. Mean Difference 



Study or Subgroup 



Mean SD Total Mean SD Total Weight IV, Random, 95*. CI 



Std. Mean Difference 
IV, Random, 95% CI 



Bovend'Eerdt et al., 2010 
letswaart et al., 2011 
Page et at., 2001 
Page et al., 2005 
Page et al., 2007 
Page et al.. 2009 
Welfingeretal., 2011 



31.7 24.97 15 30.7 23.38 



31.51 
40.4 
43.8 

25.81 
42.6 
9.6 



20.63 
13.4 
3.09 

11.29 
1.2 
18.5 



39 
8 
6 

16 
5 

15 



30.38 
25 
38.7 
17.69 
36.4 
6.5 



Total (95% CI) 104 
Heterogeneity: Tau== 0.33, ChP= 17.14, df= 6 (P = 
Test for overall effect Z = 2.1 3 (P = 0.03) 



20.53 
11.7 
1.2 
13.75 
1.1 
16.2 



15 18.2% 



32 
5 
5 

16 
5 

IS 



0.009); P= 65% 



21.8% 
11.6% 

8.8% 
18.2% 

3.1% 
18.2% 



93 100.0% 



0.04 [-0.68, 0.76] 
0.05 [-0.41, 0.52] 
1.12 [-0.11, 2.35] 

1.91 [0.36, 3.46] 
0.63 [-0.08, 1.34] 

4.86 [1.86, 7.87] 
0.17 [-0.54, 0.89] 

0.62 [0.05, 1.19] 




-10 -5 0 5 10 

Favours control Favours experimenta 



FIGURE 2 | Results of pooling for ARAT: short-term effects. Abbreviations: ARAT Action Research Arm Test; SD, standard deviation; 95% CI, 95% 
confidence interval. 



random-effect model were used. Pooling led to significant short- 
term effects on the Action Research Arm Test (p = 0.03;SMD 
0.62; 95% CI: 0.05 to 1.19). No data for long-term effects could 
be pooled. 

RESULTS ON FUNCTIONING IN ACTIVITIES OF DAILY 
LIVING— BARTHEL INDEX 

Data of the Barthel Index were available from three studies 
(Bovend'Eerdt et al, 2010; letswaart et al., 2011; Braun et al., 
2012) on short-term that randomized a total of 135 participants. 
Pooling did not show significant effects (p = 0.31; MD: 0.87; 95% 
CI: —0.80 to 2.53). No significant effects were found at follow-up 
either (p = 0.75; MD:0.46; 95% CI: - 2.36 to 3.27). Data for 
long-term effects were available from two studies (Bovend'Eerdt 
et al, 2010; Braun et al., 2012) that randomized a total of 57 par- 
ticipants. The study of Liu (Liu et al, 2009) used the modified 
Barthel Index and was therefore excluded from pooling in both 
meta-analyses. 

RESULTS FROM FUNCTIONAL ACTIVITIES— NUMERIC RATING SCALE 
(FIGURE 3) 

Four studies (Liu et al., 2004, 2009; Liu, 2009; Braun et al, 2012) 
used a numeric rating scale to assess the performance of func- 
tional activities. Two studies were excluded from the analyses 
because they did not provide any point estimates (Liu, 2009; Liu 
et al., 2009). The data of the studies by Braun et al. and Liu et al. 
were pooled using SMD because Braun et al. (2012) used a 10- 
point scale whereas Liu et al. (2004) used a 7-point scale. Liu 
et al. provide data of the average score of five activities that was 
used for the analyses. Braun et al. provided scores of the NRS 
of drinking, walking, and two self-chosen activities. We used the 
data of the most promising result (biggest different between the 
experimental and the control group) this was the score of the 
self-chosen activity for the lower limb. Data of 78 participants 
could be pooled and a marginal significant overall effect on short- 
term was found, (p = 0.04; SMD 0.9; 95% CI: 0.04 to 1.77). No 
long-term data could be pooled. 

DISCUSSION 

This present review included 16 randomized controlled trials 
(14 in stroke and two in Parkinson's disease) involving 491 



participants (of which 70 in Parkinson's disease) and shows some 
benefits of a mental practice intervention on arm hand ability 
(Page et al, 2001, 2005, 2007, 2009; Bovend'Eerdt et al, 2010; 
letswaart et al., 2011; Welfringer et al, 2011) and mobility (Liu 
et al, 2004; Braun et al., 2012) after stroke. Of the 14 iden- 
tified studies only 6 showed overall effects in favor of mental 
practice. 

No firm conclusions can be drawn from the existing evidence 
with regard to the effectiveness of mental practice in participants 
with Parkinson's disease. No randomized controlled trials within 
the multiple sclerosis target group were found. Two recently 
published non-randomized studies investigated the mental prac- 
tice ability of patients with multiple sclerosis (Heremans et al., 
2012a,b). There seems to be a potential use of mental prac- 
tice in patients with multiple sclerosis. The studies reported in 
this review remain small (sub groups ranging from 5 to 39 par- 
ticipants), the populations studied vary greatly in most clinical 
domains, and the outcomes studied also differ a lot. The method- 
ologic quality of the studies ranged from 3.5 to 8 points on 
the AMCL assessment scale after blinded assessment and also 
after additional information from the authors was taken into 
account. This review also finds some evidence for effects on 
cognition and emotion (e.g., effects on attention, plan actions 
in unfamiliar surroundings) and reports several observed side- 
effects (e.g., might increase motivation and arousal and reduce 
depression, but may also lead to diminished concentration and 
irritation). 

Four recent zero trials (Bovend'Eerdt et al., 2010; letswaart 
et al., 2011; Braun et al, 2012; Schuster et al., 2012) have 
been added to the body of knowledge on mental practice (n = 
226), accounting for about half of the total number of par- 
ticipants within all 14 included trials in stroke. Within these 
zero trials the sample sizes are bigger and more heterogeneous. 
In addition, more measures on activity level in more general 
sense were used within these later trials (Barthel Index, BI, and 
Rivermead Mobility Index, RMI). One could hypothesize that the 
effects of mental practice are mainly related to aspects as veloc- 
ity, precision, and coordination of a movement. Improvement 
in these specific effects of mental practice are perhaps not or 
hardly detectable with these more generic measures contrary 
to f.i. the ARAT. In the ARAT and the NRS meta-analyses 
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Study or Subgroup 



Experimental 
Mean SD Total 



Control 
Mean SD Total 



Std. Mean Difference 
Weight IV, Random, 95% CI 



Std. Mean Difference 
IV, Random, 95% CI 



Braun et al.. 2012 
Liu et al., 2004 



7.19 
5.3 



1.6 
1 



16 

26 



6.38 
4 



1.9 
0.9 



Total (95% CI) 42 
Heterogeneity: Tau== 0.27; Chi== 3.28, df= 
Test for overall effect: Z= 2.04 (P= 0.04) 



1 (P= 0.07), F 



16 
20 



48.8% 
51.2% 



36 100.0*b 

= 70% 



0.45 [-0.25, 1.15] 
1.33 [0.68, 1.98] 



0.90 [0.04, 1.77] 




-4 -2 0 2 4 
Favours experimental Favours control 



FIGURE 3 | Results of pooling for NRS: short-term effects. Abbreviations: NRS, Numeric Rating Scale; SD, standard deviation; 95% CI, 95% confidence 
interval. 



outcome of both zero and positive trials were pooled, lead- 
ing to small effect sizes for mental practice in these outcome 
measures. 

Imagery research is still booming and after our search was 
completed (June 2012) results of new trials were published (f.i. 
two recent studies on the effects of imagery on gait (Cho et al, 
2012; Guttman et al., 2012)). These studies however remain rel- 
atively small, but adding new trials to the models could still 
overturn the results (Langhorne et al, 2009). 

STUDY LIMITATIONS 

There is a possibility that studies were missed due to inconsistency 
in terminology used in databases (e.g., mental practice, motor 
imagery, movement imagery). 

The varied clinical populations in this review can be seen as 
a limitation. This review however does summarize the existing 
information in neurorehabilitation about a widely used inter- 
vention, which will facilitate the exchange of existing knowledge 
and evidence between professionals working with different target 
populations. Reviews covering the evidence for specific interven- 
tions in multiple target groups, like the recently published one 
by Newman and Barker (2012) on supported standing, will help 
professionals get a better understanding of the intervention and 
potential (side-) effects. 

Using assessment scales in general and therefore also the 
AMCL for rating methodologic quality leads to some practical 
issues. Blinding of therapists and patients is often not possible 
in therapeutic interventions like mental practice. If therapists 
instruct the patients they are not blind to the type of intervention 
they are providing. The same accounts for the patients when they 
are asked to actively participate in an intervention. In randomized 
controlled trials in which therapeutic interventions (e.g., physio- 
therapy and occupational therapy) are researched the assessment 
of the randomized controlled trials with any assessment scale will 
be lower than in for instance pharmaceutical studies. The highest 
possible score on the AMCL of 1 1 points will decrease in many 
therapeutic studies by 2 points, as double blinding is often not 
possible. 

Different assessment tools were used to rate the quality 
of the included studies (PEDro (Nilsen et al, 2010; Barclay- 
Goddard et al, 2011), AMCL (Braun et al., 2006), JADAD 
(Cha et al, 2012)) in earlier reviews. The PEDRO and AMCL 
are derived from the Delphi list and therefore interrelated 
(Olivo et al., 2008). The JADAD is a shorter list, most used 



even though it was not originally developed for therapeutic 
studies (Olivo et al., 2008). Sometimes the studies within the 
reviews were categorized into lower and high quality studies 
(Braun et al., 2006; Zimmermann-Schlatter et al, 2008; Cha 
et al., 2012) and sometimes the authors of trials were contacted 
to provided additional information (Barclay-Goddard et al., 
2011). 

We contacted the authors to clarify the criteria on which a 
question mark was scored after the blinded reviewing assessment 
by the independent reviewers was performed. The quality assess- 
ment of identical studies may therefore vary within the different 
reviews as scores on assessment tools normally go up after addi- 
tional information is retrieved. In one review the quality criteria 
for assessment of the identified studies were chosen by the review- 
ers (Zimmermann-Schlatter et al., 2008). These differences make 
it harder to compare the results and recommendations from the 
reviews. 

Good reporting of trials is important to understanding 
changes and effects of mental practice and therefore ongoing 
attention to high quality study reports is required (Barclay- 
Goddard et al., 201 1). Guidelines, like the CONSORT statements 
are essential to achieve this. 

The biggest problem of researching mental practice is the lack 
of consensus on the definition and concept of the intervention. 
Heterogeneity within the intervention protocols and outcomes 
makes it impossible to conduct an overall pooling and thus to 
come to an overall conclusion. 

Results from pooling based on identical outcome measures 
should be interpreted with caution because of the heterogene- 
ity in study populations. Also, results from meta-analyses depend 
very much on the data (and models) used. We decided to base 
the decision on which model to use on the measurement instru- 
ments (identical instruments or instruments measuring the same 
construct) and on the variance in SDs across the included studies. 
The downside of this flexibility in data/model choice is that it is 
harder for the reader to follow what has been done in the anal- 
ysis. The biggest and in our opinion more important advantage 
is that the outcome is less misleading. Big variation in SDs across 
studies reflect differences in the real variability of outcomes and 
the use of MD would in our case suggest potential effects which 
are probably not there. The study by Ietswaart et al. (2011) with 
the largest population would for instance have the lowest weight 
in the meta-analysis and studies with relatively small sample sizes 
would determine outcome for more than 80%. We tried to correct 
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for this heterogeneity in the analysis and we used change scores 
instead of effect sizes which might explain to some extend why 
our results are less optimistic than the meta-analysis by Cha et al. 
(2012). In the meta-analysis by Cha et al. mental practice com- 
bined with exercise therapy had an even bigger effect size (ES 0.5 1 ; 
moderate) then augmented therapy alone (Cha et al., 2012). Two 
other reviews (Nilsen et al, 2010; Barclay-Goddard et al., 2011) 
performed statistical analyses to synthesize the evidence of six 
(Barclay-Goddard et al, 201 1) and four (Nilsen et al., 2010) stud- 
ies. Differences in statistical analysis approaches should be taken 
into account when interpreting and comparing the results. 

Publication bias is a potential weakness in all systematic 
reviews, as positive or statistically significant findings are more 
likely to be published than small trials with non-significant or 
negative findings (Thornton and Lee, 2000). The funnel plot 
of the ARAT showed indication for publication bias (results 
not presented) and should therefore be interpreted with care. 
Barclay-Goddard et al. (2011) identified some risk of bias with 
regard to concealment of allocation and blinding. Cha et al. 
(2012) did not report any significant publication bias in their 
investigation. 

STRENGTHS AND LIMITATIONS OF PAST STUDIES 

Determining effects of complex interventions like mental practice 
is complicated (Braun et al., 201 lb). A systematic way of assessing 
the potential of mental practice could be through the four steps 
suggested by the Medical Research Council (Craig et al., 2008). 
Until now, most research has been performed in the first two steps 
of this model: "determining the working mechanisms" and "pilot- 
ing." Fundamental research has shown that mental practice can be 
performed in patients with neurological conditions and showed 
that the underlying mechanism is also working in at least parts of 
the patient populations. 

The past 5 years more research has been published on 
techniques that might assist in monitoring and implementing 
imagery treatments, like tests (e.g., chronometry, hand-rotation- 
test; Malouin et al., 2008a; Simmons et al., 2008) and question- 
naires (e.g., KVIQ; Malouin et al, 2007, 2008b). Mental practice 
has been explored in different clinical situations and contexts and 
a range of different types of intervention, assessed with differ- 
ent measures, have been studied. However, the predictive value 
of these tests has not been established yet. So we do not know 
for sure if people who can image according to questionnaires and 
tests will also benefit from it and whether participants who are 
at first unable to image, are able to learn and potentially benefit 



from imagery. In addition, if imagery tests are used as a selec- 
tion tool patients who are unable to perform these tests are often 
excluded from research. That is why the study by Welfringer et al. 
(201 1) is of value. Although the results should be interpreted with 
great caution because participants in the control group did not 
receive supplementary therapy on top of therapy as usual to con- 
trol for mental practice, it is until now the only mental practice 
randomized controlled trial in patients with neglect. Researching 
feasibility and effects in sub groups that are normally excluded 
from research will tell us more about whether mental practice can 
be taught and who might benefit. 

There are general methodologic issues in rehabilitations trials 
(Dobkin, 2007) that also should be considered in mental practice 
studies. The main problem is that almost all studies are under- 
powered, increasing the chance of type-2 errors. Especially in 
mono-centered, small trials the samples are not likely to reflect 
the real-world sample. 

RECOMMENDATIONS FOR THE DESIGN OF FUTURE TRIALS 

Recent negative trials have shown that not all participants with 
stroke and Parkinson's disease benefit from mental practice. At 
this point we do not know how to identify the people who might 
benefit from mental practice. Sample sizes of future trials should 
be large enough to enable sub group and dose-response analyses. 
For dose-response analyses adherence, attendance, and compli- 
ance should be reported (Barclay-Goddard et al., 20 1 1 ) . Especially 
adherence and compliance are difficult to assess as mental practice 
is an intervention that takes place in the mind and remains covert 
for the therapist. For adherence to mental practice it is essen- 
tial that participants can engage in movement imagery. However, 
there is no perfect test to assess this ability. Combining some tests 
might provide indicators which then might be related to out- 
come. Therefore, the imagery ability of every participant should 
be assessed before and/or after the mental practice intervention. 

The mental practice intervention should be well described. 
Both, short- and long-term effects should be measured with 
predefined measure instruments to enable comparison of results 
among different studies. Effects should not only be sought at the 
physical level, but also on emotion and cognition (Nilsen et al., 
2010; Barclay-Goddard et al., 2011). Reporting the opinions on 
and experiences with mental practice of people with neurological 
diseases, care-givers, and care professionals will provide valuable 
information on how to optimize and tailor the mental practice 
intervention to the patients' needs and abilities. Mixed methods 
are needed to assess these different components. 
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Table A1 | Amsterdam-Maastricht Consensus List for quality assessment rating criteria. 


Item 


Rating criteria 


(1A) Randomization 


Item has a positive score if the concealment of treatment allocation is explicitly described to be 




randomized (e.g., computer generated block randomization) 




Note: Quasi-randomization is scored negative (e.g., randomization of dates of birth or day of the week) 


(1 B) Concealment of allocation 


Item has a positive score if explicitly is described that the allocation of the intervention was blinded (e.g., a 




independent assessor performs the allocation and has no information/influence on who will be allocated to 




which group) 


(2) Comparable sub groups at baseline 


Item has a positive score if the study groups are comparable at baseline with the most important 




prognostic factors (e.g., comparable mean age and standard deviation in the study groups) 


(3) Blinded care provider 


Item has a positive score if the care provider is blinded regarding treatment allocation (e.g., the care 




provider is unaware of the content of the intervention*) 


(4) Correction for attention; same 


Item has a positive score if the different intervention groups have the same treatment dose and if 


treatment (dose), co-intervention 


co-interventions are equally divided among the intervention groups. Also, participants in both groups are 




asked to provide the same information (e.g., fill in logs) and undergo the same tests (battery) 


(5) Acceptable compliance 


Item has a positive score if participants themselves or therapist and relatives report that the participants 




followed the given instructions (e.g., through logs, interviews) 


(b) blinded patient 


Item has a positive score if patients are blinded regarding treatment allocation and if the method of 




blinding is appropriate (e.g., the patient is unaware of the treatment content*) 


(7) Acceptable withdrawals during 


Item has a positive score if the percentage of patients that drop out of the study does not exceed 10% 


1 1 1 Lcl vcl 1 LIUI I pcllUU 


UUI II 1 y LI Ic 1 1 1 Lc 1 Vc 1 1 LIUI 1 (JcllUU. Ml IU LI lcl IU /O U 1 lUbb LU \ Ul IUVV U \J U 1 LI Ic Icllldlillliy bdl r 1 pic lb be L db 




acceptable for the follow-up period 


Rlinrlorl nntrnmo accoccnr 

\0/ DIM lUCU UULUUIIIC aoaCJSUI 


Itom hac a ni~iciti\/o crnro if tho r»i itpnmo accoccnrc aro HIinHaH ronarrlinn troatmont allni^a+inn lo n 

1 LCI 1 1 lido d (JUo 1 LI VC oLUI CM 11 IC UU LL.UI IIC OooCSoUla dIC UIIIIUCU 1 Cy d 1 HI 1 iy LICdLIIICIIL dl lUUd liui i \c . y . , 




independent raters, who are unaware of the treatment group that the participant is in-preferably checked 




by asking the rater to predict who is in which group) 


(9) Relevance measures 


Item has a positive score if the measurement instruments allow answering the research question 


(10) Timing assessment 


Item has a positive score if the outcome assessment takes place approximately at the same time in all 




intervention groups. Also, a follow-up period of at least 3 months is set to be acceptable 


(11) Intention to treat analysis 


Item has a positive score if all randomized patients are reported for all measuring points and are analysed 




according to the group they were originally randomized to 



'Blinding of the care provider and of the patient is not always applicable in physical therapy because of the nature of physical therapy interventions (e.g., manual 
therapy, exercises). Proper double blinding, therefore, is unlikely to be accomplished for most physical therapy trials (Olivo et al., 2008). 
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